🕷️️ Job Radar • SCRAPING

upwork.com 🟡 2026-05-08

🔹 [Target] Weekly collection and storage of public cattle catalogue data [Method] Python web-scraping and data pipeline development [UI/UX] Not specified [Stack] Playwright/Selenium, Beautiful Soup, pandas, SQLite/PostgreSQL, scheduled jobs [Security] Not specified [Format] CSV/Excel export
👤 Client: 🇦🇺 Australia Member since 2026-05-07
💰 Price: ****
🚩 Problem: Automate the collection of public cattle catalogue data for a breeding decision-support platform.
📦 Existing: [Target] Not specified [Method] Python web-scraping and data pipeline development [UI/UX] Not specified [Stack] Playwright/Selenium, Beautiful Soup, pandas, SQLite/PostgreSQL, scheduled jobs [Security] Not specified [Format] CSV/Excel export

Specifications:

[Target] Collect public AWA cattle catalogue data weekly.
[Method] Use Python with Playwright or Selenium for web-scraping and BeautifulSoup for parsing HTML.
[Stack] Utilize pandas for data manipulation, SQLite or PostgreSQL for local database storage.
[Format] Export ranked CSV/Excel reports.
[Security] Implement basic change tracking to identify updated records.

Workflow:

1. Set up web-scraping environment with Playwright/Selenium and BeautifulSoup.
2. Define scraping logic to collect AWA public cattle data weekly.
3. Store collected data in a local SQLite/PostgreSQL database.
4. Implement scheduled jobs for automated data collection.
5. Develop basic scoring model to rank animals based on different mating objectives.
6. Export ranked CSV/Excel reports with change tracking.